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Abstract 

A  theoretical  model  for  the  visual  integrative  process  is  advanced 
that  is  based  upon  microel* c trode  studies  of  th^  animal  visual  cortex 
by  Hubei  and  Wits el,  Jung,  and  others.  In  this  theoretical  model  the 
cortical  columns  of  direction-sensing  elements  found  by  Hubei  and  Weis el 
are  interpreted  as  sets  of  isoclines  making  up  the  visual  field.  The 
form  of  a  visual  image  corresponds  to  a  family  of  contours  ("orbits”  or 
"paths",  in  the  terminology  of  differential  equations)  that  pass  through 
those  isoclines  stimulated  by  the  corresponding  retinal  regions.  A  con¬ 
tour  of  an  Image  is  thus  approximated  in  the  visual  cortex  as  an  iso¬ 
clinic  polygonal  arc. 

Hubei  and  Wiesel's  microelectrode  studies  are  thus  strongly  sug¬ 
gestive  of  a  differential  equation  interpretation  of  the  visual  inte¬ 
grative  process.  The  invariance  of  the  visual  integrative  process  under 
rigid  motions  (translation  and  rotation)  and  perspective  that  is  required 
by  the  psychological  phenomenon  of  Gestalt  enables  us  to  specify  the 
particular  form  of  the  differential  equations  involved.  The  latter 
then'permit  a  ready  explanation  of  such  visual  phenomena  as  McKay's 
complementary  after  images,  the  whirling  spiral  images  evoked  under 
flicker,  and  the  alpha  rhythm  and  its  desynchronization. 


I. 


INTRODUCTION 


Historically,  pattern  recognition  has  been  synonymous  with  statis¬ 
tical  classification.  A  pattern  is  abstracted  as  a  point  in  a  finite¬ 
dimensional  sample  space,  the  dimensionality  of  which  corresponds  to 
the  number  of  identifiable  characteristics  of  the  pattern.  The  procedure 
for  pattern  recognition  then  involves  partitioning  the  n -dimensional 
sample  space  in  such  a  way  that  the  sample  points  representing  one  class 
of  patterns  are  essentially  separable  from  the  region  associated  with 
any  other  class.  As  such,  this  is  a  generalized  form  of  the  statistical 
problem  of  classifying  an  observation  into  one  of  finitely  many  popula¬ 
tions  (Anderson,  195%,  Ch.6;  Rao,  1952,  Chs .  8,9;  Sebestyen,  1962; 
Abramson,  1963;  Braverman,  1963). 

Certain  aspects  of  this  approach  run  counter  to  what  one  ordinarily 
thinks  of  as  constituting  a  "pattern1',  namely,  some  sort  of  connected 
configuration  without  essential  discontinuities  in  its  geometry,  smooth¬ 
ness,  symmetry  or  the  like.  An  optical  image,  for  example,  may  be 
thought  of  as  a  collection  of  contours  (or  paths)  .  It  is  not  cieai 
that  the  optimal  recognition  procedure  lies  in  abstracting  this  image 
to  a  single  point  of  a  higher-dimensional  space  obtained  from  a  sub¬ 
division  of  the  image  into  n  rectangular  elf  men ts.  In  fact  Swerling 
(1962)  has  given  arguments  indicating  that  analysis  of  a  random  surface 
in  terms  of  contours  requires  appreciably  less  information,  and  similar 
economies  have  been  noted  by  Attr.eave  and  Arnoult  ( 1966)  ,  Capon  (1959), 
Unger  (1959),  Wholey  (1961),  and  others. 
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For  such  patterns  as  optical  (or  visual)  images  it  seems  clear 
that  the  character! zation  would  be  improved  by  retaining  their  con¬ 
figurational  aspects.  Since  an  image  may  be  characterized  by  the 
arrangement  of  contours  in  it,  the1  usual  finite -dimensional  character¬ 
ization  of  classical  pattern  recognition  theory  should  be  improved  by 
taking  the  full  geometry  into  account.  A  number  of  approaches  are 
then  possible. 

Each  contour  in  the  figure  can  be  considered  as  a  point  in  an 
infinite-dimensional  space,  namely  the  semi -Banach  space  of  curves 
(Frechet,  1962).  This  approach  may  be  particularly  well  suited  to 
a  generalization  of  the  classical  pattern  recognition  method  of  sepa¬ 
rating  regions  corresponding  to  the  various  classes  by  means  of  finite¬ 
dimensional  hyptrplanes.  The  question  of  linear  separation  (classifi¬ 
cation  by  a  separating  hyperplane)  of  subspaces  of  reflexive  Banach 
spaces  has  recently  been  settled  by  James  (1964)* 

However,  the  less  abstract  approach  embodied  in  contour  repre¬ 
sentation  by  means  of  tricoordinate3  (abscissa,  ordinate,  and  slope) 
(Attneave  and  Arnault,  1956)  apparently  has  more  far-reaching  impli¬ 
cations  for  such  pattern  recognition  phenomena  as  the  visual  integrative 
process.  Our  study  of  pattern  recognition  will  therefore  be  couched 
largely  in  terms  of  tricoordinates,  or  direction-field  elements. 

Still  another  approach,  that  in  fact  is  closely  related  to  that 
of  tricoordinates  (especially  in  the  recognition  aspect  itself),  follows 
from  regarding  visual  patterns  as  Markov  processes  in  time  and  space. 
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Thf  work  of  Beutler  (1963)  leads  naturally  to  such  in  interpretation, 
once  the  statistical  decision  problem  arising  out  of  the  association 
between  differential  equation  and  contour  comes  under  consideration. 
We  note  that  trajectories  are  involved  in  both  approaches. 

As  noted  above,  the  tri coordinates  of  a  point  on  a  curve  consist 
of  the  rectangular  coordinates  of  the  point  and  the  1  xral  value  of 
the  derivative 


A  well  known  result  from  the  theory  of  differential  equations  (Bieber- 
bach,  1956,  p.  27)  states  that  an  approximative  nolygonal  arc  made  up 
of  n  such  elements,  each  of  which  consists  of  a  point  and  the  asso¬ 
ciated  local  tangent,  can  be  made  to  approach  arbitrarily  close  to  an 
integral  curve  of  the  differential  equation 

so  long  as  f  remains  continuous.  The  essential  feature  of  our  theo¬ 
retical  model  for  the  pattern  recognition  process  is  the  approximation 
of  a  contour  by  such  a  polygonal  arc  as  that  described  above.  Form 
vision  rather  than  brightness  is  of  primary  interest  in  the  present 
context,  and  color  vision  is  not  considered  at  all.  Brightness  is 
in  principle  readily  taken  into  account  by  including  in  the  rnrm 
character  specified  by  f(x.y)  in  (?)  the  frequency  of  firing  of  the 
particular  neurons  involved  (Rushton,  1961;  Jung,  1961  a,b). 
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As  will  be  eh  own  below,  the  polygonal  arc  approximation  to  a 
shape  leads  naturally,  in  the  context  of  tne  visual  integrative  pro¬ 
cess,  to  the  graphical  integration  technique  known  as  the  method  of 
isoclines  (Andvonow  and  Chaikin,  1949;  Cunningham,  1958;  Kaplan,  1958). 
The  Gestalt  character  of  visual  pattern  recognition  c.emands  invariances 
of  a  type  associated  with  Lie  groups  (Cohn,  1957;  Inre,  1956;  Kowalewski , 
1950;  Lie  and  Scheffers,  1893;  Yano,  1957).  Invariance  under  the  appro¬ 
priate  Lie  groups  tells  us  what  particular  form  the  differential  equa¬ 
tions  must  have.  The  theory  of  these  differential  equations  is  then 
developed  and  related  to  such  visual  phenomena  as  Jung's  A,B,C,D,E 
type  neurone  (Jung,  1961  a,b)  ,MacKay 's  complementary  after  images,  the 
alpha  rhythm  and  its  desynchronization,  and  the  whirling  spirals  often 
evoked  under  flicker  (Walter,  1953).  S.'gn  reversal  in  this  system  of 
differential  equi lions  governing  the  visual  integrative  process  is 
apparently  closely  related  to  such  conditions  as  developmental  dyslexia 
(Bender,  1957;  Money,  1961;  Stuart,  1963),  but  a  complete  discussion 
of  this  will  be  reserved  for  a  separate  publication.  The  statis tical 
decision  theory  aspects  of  pattern  recognition  via  the  method  of 
isoclines  will  also  be  only  briefly  taken  up  in  the  present  paper. 


5 


II.  MICROELECTRODE  EXPLORATION  OF  THE  VISUAL  CORTEX 

The  use  of  microelectrode s  for  deep  penetrations  of  the  animal 
cortex  in  the  manner  of  Mountcastle  (M  uuntrastle ,  1957;  Powell  and 
Mount  as  tie,  1959)  has  provided  neurophysiologists  with  a  powerful 
new  tool  for  determining  the  response  characteristics  of  single  cor¬ 
tical  neurons.  Microelectrode  studies  have  been  made  of  the  cat 
auditory  pathway  (see  Katsuki ,  1961,  and  the  references  cited  there); 
the  somatic  afferent  system  in  cat  and  monkey  (Mountcastle,  1961);  and 
the  visual  pathway  in  the  cat  (Hubei,  1963a;  Jung,  1961  a,b)  It  is 
primarily  the  latter  that  will  concern  us  here. 


1. 


It.  their  series  of  microelectrode  studies  of  the  animal  visual  path¬ 
way  Hubei  and  Wiesel  (Pubel  and  W.iesel,  1962;  Hubei,  1963  a,b)  mapped 
out  the  microresponse  fields  in  the  brain  unier  stimulation  of  the  retina 
by  very  small  patterns  of  light.  The  visual  stimulus  is  initially  pro¬ 
cessed  by  the  retinal  cells  in  the  vicinity  of  the  illuminated  spot.  In 
this  processing  the  phenomenon  of  lateral  inhibition  plays  a  prominent 
role.  The  visual  stimulus  is  then  transmitted  along  the  optic  nerve 
and  through  the  lateral  geniculate  body  to  the  striate  (or  visual)  cortex. 
The  cells  in  the  retina  and  the  lateral  geniculate  body  have  a  predomi¬ 
nantly  circular  response  (fig.l)  of  either  excitatory  or  inhibitory  type. 
The  shape  of  the  response  surface  looks  very  similar  to  that  for  a  single 
cable  in  a  ami ti -channel  telephone  cable,  wh^re  veiy  small  sideband  levels 
are  used  to  reduce  crosstalk. 
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Fig.  1  Circular  response  of  receptive  fields  of  the  lateral 
geniculate  body,  (x,  areas  giving  excitatory  -"on"- 
respooses;  A,  areas  giving  inhibitory  -"off"-  responses) 
From  Hubei  and  Wiesel  (1962). 


The  cells  in  the  striate  corter  on  the  other  hand  respond  in  an 
entirely  different  manner,  being  arranged  in  fields  with  highly  linear- 
responses  (fig.  2).  On*3  type  of  such  fields,  termed  "simple",  responds 
only  when  the  linear  light  stimulus  encounters  the  boundary  between  its 
inhibitory  and  excitatory  sub-fields.  The  response  is  strongly  direc¬ 
tional,  an  angular  difference  of  at  most  10°  (and  usually  considerably 
less)  between  hne  axes  of  linear  light  source  and  receptive  field  being 
enough  to  annul  the  response. 


The  second  type  of  receptive  field,  termed  "complex"  by  Hubei  and 
Wiesel,  is  also  highly  orientation  sensitive,  but  is  characterized  by 
exhibiting  a  sustained  response  as  the  light  stimulus  is  moved  over 
relatively  large  regions  of  the  rstina.  The  complex  fields  behave 
as  if  they  received  their  afferents  from  a  large  number  of  the  cortical 
cells  in  simple  fields,  all  of  which  have  essentially  the  same  axis 
orientation  but  which  vary  slightly  among  themselves  in  retinoptic  pro¬ 
jection. 


Fig.  2. 
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Linear  response  of  receptive  fields  of  the  visual 
cortex,  (x,  areas  giving  excitatory  -"on"-  responses; 

A,  areas  giving  inhibitory  -"off"-  responses.  Receptive 
field  axes  are  indicated  by  continuous  lines  through 
field  centers.)  From  Hubei  and  Wies^l  (1962). 


Fig.  3.  Reconstruction  of  microelectrode  penetration  through  the  lateral 
gyrus  (from  Hubei  and  Wiesel  (lQ62)).  The  electrode  entered  the 
apical  segment  normal  to  the  surface  and  advanced  parallel  to  the 
deep  fiber  bundles  (indicated  by  radial  lines)  until  white  matter 
was  encountered.  In  the  further  advance  of  the  electrode  through 
the  gray  matter  of  the  mesial  segment  the  course  was  oblique.  The 
receptive  field  orientations  of  the  cortical  cells  are  indicated 
by  longer  lines  transverst  to  the  electrode  track;  crossbars  at 
the  right  hand  end  of  the  lines  indicate  axons.  Approximate  posi¬ 
tions  of  receptive  fields  on  the  retina  are  shown  to  the  right  of 
the  penetration.  Short  lints  transverse  to  the  electrode  track 
indicate  unresolved  background  activity. 
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Receptive  field  axes*  of  all  orientations  are  found  in  the  visual 
cortex,  the  only  apparent  regularity  consisting  of  alignment  either 
nearly  parallel  or  nearly  perpendicular  to  the  radial  fiber  in  the 
immediate  vicinity.  This  feature  is  evident  from  figs.  3,4,5,  repro¬ 
duced  here  from  Hubei  and  Wiesel  (1962)  and  Hubei  (l?63o). 


Fig.  4.  Reconstruction  of  two  penetrations  in  the  apical  segment 
of  the  post-lateral  gyrus,  near  its  anterior  end  (from 
Hubei  and  Wiesel  (1962)).  Legend  as  for  fig.  3.  Note 
the  abrupt  transition  from  receptive  fields  parallel  to 
the  radial  fibers  to  transverse  receptive  fields  in  the 
terminal  portion  of  the  rightmost  track. 


*  The  receptive  field  axis  is  a  hypothetical  line  through  the  center  of 
the  receptive  field  and  directed  along  the  boundary  between  excitatory 
and  inhibitory  regions  (fig.  2)  . 
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The  principal  characteristic  that  distinguishes  complex  fields 
from  simple  fields  is  that  the  former  respond  with  sustained  firing 
to  moving  lineal  stimuli.  The  simple  fields,  responsive  only  at  the 
boundary  between  excitatory  and  inhibitory  regions  (fig.  2),  fire  on 
the  other  hand  only  for  the  relatively  brief  period  when  the  moving 
stimulus  crosses  the  boundary.  It  would  thus  appear  that  the  relatively 
great  sensitivity  of  the  visual  cortex  to  moving  stimuli  is  intimately 
bound  up  with  the  complex  fields. 

The  cells  themselves,  simple  and  complex,  are  apparently  arranged 
in  cylindrical  columns  perpendicular  to  the  local  cortical  surface. 

The  column  axes  seem  to  be  essentially  the  same  as  those  of  the  deep 
fiber  bundles.  Within  these  columns,  the  receptive  field  axes  appear 
to  be  conjugate  (that  is,  each  other’s  orthogonal  trajectories)  (figs.  3 
and  5) ,  some  axes  being  (essentially)  perpendicular  to  the  local  deep 
fiber  bundle,  the  others  (essentially)  parallel  to  it. 

The  projection  of  retinal  regions  upon  the  visual  cortex  is 
ordered,  i.e.,  the  receptive  fields  contained  in  a  given  cortical 
column  respond  to  corresponding  portions  of  the  two  retinas.  Hubei 
and  Wiesel  (1962)  state  that  within  such  a  column  defined  by  common 
orientation  of  receptive  field  axes  there  is  no  apparent  progression 
ill  field  positions  along  the  retina  as  the  electrode  advances,  and 
conclude  that  at  the  microscopic  level  the  retinoptic  representation, 
within  a  given  cortical  column,  no  longer  strictly  holds.  Hubei  and 
Wiesel  do  detect  an  apparently  random  staggering  of  receptive  field 
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Fig  5.  Diagrammatic  representation  of  the  cortical  columns  of 
receptive  fields  (after  Hubei  (1963b)).  Lines  A  and  B 
indicate  tracks  of  two  raicroolectrode  penetrations. 

positions  for  a  given  cortical  column.  Upon  close  examination  this 
staggered  structure  does,  however,  seem  to  display  a  systematic  varia¬ 
tion  of  retinoptic  position,  upon  which  is  superimposed  a  random  "jitter". 
An  ordered  relation  between  progressive  depth  of  electrode  penetration 
distance  from  the  area  centralis  is  detectable  (fig.  6) s  For  a 
given  angular  bearing  with  respect  to  the  area  centralis,  the  farther 
the  retinal  receptive  field  is  from  the  a r«.a  centralis ,  the  greater, 
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in  general,  the  depth  of  the  associated  cortical  receptive  field  below 
the  cortical  surface. 

The  degree  to  which  the  observed  random  variation  represents  true 
random  staggering  of  the  cytostructure  is  not  clear.  It  would  seem 
that  the  effects  of  deformation  of  the  cytoatructui-e  by  the  passage  of 
the  electrode,  and  angular  errors  of  electrode  direction  with  respect 
to  column  axis  must  enter  as  well  as  the  randomness  present  in  the 
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Fig.  6.  Reconstruction  of  portion  of  electrode  track  through  apical  and 
mesial  segments  of  post-lateral  gyrus  near  its  anterior  end  made 
during  multiple  recordings  (after  Hubei  and  Wiesel  (1962)). 

(Only  the  first  twelve  cellB  are  represented.  Broken  cl  *ves 
indicate  the  boundaries  of  layer  4.)  The  overlapping  rectangles 
in  the  leftmost  part  of  the  figure  display  the  superposition  of 
receptive  fields  upon  the  retina,  whose  coordinate  system  appears 
directly  above  (origin  referred  to  area  centralis) . 

The  progression  of  similarly-oriented  receptive  fields  is  shown 
in  the  central  portion  of  the  figure.  The  rectangles  outlined 
with  broken  lines  are  the  receptive  fields.  The  crosses  indi¬ 
cate  the  relative  position  and  bearing  of  the  corresponding 
area  centralis .  The  numbers  to  the  right  give  the  field  sequence: 
1-12.  The  field  following  field  12  is  apparently  transverse  to 
an  adjacent  radial  fiber.  The  arrows  show  the  preferred  direction 
of  movement  of  a  slit  oriented  parallel  to  the  receptive  field 
axis. 
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The  resemblance  of  these  cortical  columns  of  oriented  direction 
fields  to  the  method  of  isoclines  (or  "direction  field  method”)  for 
the  graphical  solution  of  differential  equations  (Andronov  and  Chaikin, 
1949}  Cunningham,  1958}  Kaplan,  1958)  is  indeed  striking  (fig.  7). 
Regarding  an  optical  image  as  an  ensemble  of  contours,  ve  hypothesize 
the  following  theoretical  model  for  the  visual  integrative  process: 

The  whole  visual  field  is  permanently  filled  up  with  tiny 
directional  elements  that  are  essentially  isoclines  (elements 
of  same  slope)  arranged  in  cortical  columns.  A  visual  image 
stimulates  only  those  isocline  nets  that  correspond  to  forms 
in  the  image.  The  ensemble  of  slope  elements  corresponding 
to  a  given  image  contour  thus  comprises  a  polygonal  arc 
approximation  to  the  solution  of  the  differential  equation 
defining  that  image  contour. 

The  significant  feature  is  that,  in  terms  of  what  actually  happens  in 
the  visual  cortex,  the  image  is  characterized  not  so  much  by  the  forms 
that  make  it  up  but  rather  by  the  differential  equations  (and  initial 
or  boundary  conditions)  that  govern  these  shapes.  The  visual  cortex 
thus  seems  to  possess  a  built-in  structure  for  graphical  integration 
of  the  differential  equations  of  visual  forms. 

The  many  other  microelectrode  studies  of  the  cerebral  cortex  and 
the  visual  pathway  that  have  been  wade  are  well  described  by  Amassian 
(1961)  and  Jung  (1961,  a,b).  These  studies  have  been  voluminous,  but 


! 
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only  those  aspects  that  bear  directly  upon  our  theoretical  mode]  will 
be  summarized  here.  In  particular  the  work  of  Jung  and  his  school 
(Jung,  1961  a,b)  seems  to  have  very  direct  implications  for  the  kind 
of  excitations  appropriate  to  our  theoretical  model.  In  addition 
these  papers  are  notable  for  a  thoroughgoing  summary  of  the  connec¬ 
tions  between  the  neurophysiology  of  the  feline  visual  cortex  and  the 
psychophysiology  of  vision  in  man. 
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Figure  7.  The  method  of  isoclines.  Small  arrows  indicate 
directed  slope  elements.  The  isoclines  are  the 
raOial  lines,  each  of  whose  slope  elements  are 
parallel.  (After  Andronow  and  Chaikin  (1949)). 


Jung  (1961  a,b)  distinguishes  five  classes  of  cortical  neurons 
according  to  their  characteristic  excitation-inhibition  response  under 
either  diffuse  or  patterned  light  stimuli.  Type  A  neurons  are  in  a 


class  by  themselves .  They  fire  regularly  at  a  frequency  of  from  8  to 
15  discharges  per  second  but  show  no  response  to  either  light  or  darkness. 
They  are  apparently  driven  by  nonspecific  re ticulo thalamic  stimuli  and 
constitute  a  "...  medium  background  of  excitation  in  the  cortex..." 

(Jung,  1961a,  p.  631) . 

Type  B,C,D,E  neurons  on  the  other  hand  are  light  (and/or  dark) 
responsive,  and  are  classified  according  to  their  characteristic  response 
under  illumination  of  the  retina.  Type  B  and  D  neurons  are  apparently 
duals  (antagonists)  of  each  other.  The  type  B  neurons  impart  brightness 
information;  they  are  activated  by  light  and  inhibited  by  darkness. 

The  type  D  neurons  on  the  other  hand  impart  relative  darkness  informa¬ 
tion;  they  are  inhabited  by  light  and  activated  by  darkness.  Type  C 
neurons  are  inhibited  at  both  the  onset  and  termination  of  a  light 
stimulus.  T^pe  E  neurons  show  a  relatively  long -delayed  response  to 
a  light  stimulus  but  a  strong  rapid  reaction  to  the  cessation  of  light. 
The  responses  of  the  C  and  E  neurons  appear  on  occasion  to  complement 
each  other  in  somewhat  the  same  way  as  the  B  and  D  neurons  do  (Jung, 

1961  a,  Fig.  3;  Jung,  1961  b,  Fig.  l) . 

Although  the  shapes  in  the  visual  image  constitute  the  forcing 
functions  for  the  differential  equations  of  the  visual  integrative  pro¬ 
cess,  it  is  the  several  categories  just  defined  that  determine  the 
microtime  behavior  of  those  cortical  neurons  stimulated  by  the  image. 

It  is  this  latter  aspect  of  the  neuronal  behavior  that  will  be  needed 
for  relating  our  theoretical  model  to  such  phenomena  as  the  alpha 
rhythm  and  its  desynchronization. 
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III.  THE  METHOD  OF  ISOCLINES  AND  ITS  CONNECTION  WITH  THE  VISUAL 

INTEGRATIVE  PROCESS 

In  the  graphical  integration  method  using  isoclines  successive 
numerical  values  of  the  quantity  m  are  first  computed  according  to 
-  tha  equation 

m  =  f (x,y) ,  (3) 

where  f(x,y)  is  given  by  (2)  .  The  value  of  m  thus  determined  for 
the  point  (x,y)  is  then  assigned  to  the  slope  at  that  point.  A  curve 
connecting  all  points  at  which  the  slope  has  the  same  value  is  called 
an  isocline.  The  effect  of  this  procedure  is  to  reduce  the  differential 
equation  (2)  to  a  sequence  of  equivalent  algebraic  equations  of  the  form 
(3)  ,  which  then  specify  the  locus  of  those  values  of  x  and  y  along 
which  the  integral  curves  of  (2)  have  a  particular  slope  (fig.  7). 

Thus,  once  an  isocline  is  plotted  in  the  x,y-plane,  one  can  pick 
out  a  set  of  line  elements  along  the  Isocline  that  have  the  prescribed 
slope  m.  The  value  of  m  is  then  changed  and  another  isocline  curve 
plotted,  and  so  on.  The  result  is  to  eventually  fill  up  the  entire 
x,y-plane  with  isoclines,  each  carrying  directed  line  elements  of  a 
given  slope  (fig.  7). 

Next  one  starts  from  a  given  initial  point  and  sketches  a  smooth 
curve,  always  following  the  slope  of  successive  line  elements  in  adjacent 
isoclines.  This  procedure  yields  a  graphical  solution  of  the  initial 

value  problem.  A  different  initial  value  will  in  general  lead  to  a 
different  graphical  solution.  The  process  is  in  principle  capable  of 
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any  prescribed  degree  of  accuracy,  depending  upon  the  scale,  the  distance 
between  adjacent  isoclines,  and  the  total  number  of  slope  elements  along 
each  isocline. 

It  thus  appears  from  Hubei  and  Wiesel's  microelectrode  studies  (Hubei 
and  Wiesel,  1962)  that  the  visual  cortex  carries  a  direct  counterpart 
of  an  isocline  net,  the  slope  elements  being  Hubei  and  Wiesel's  simple 
fields  and  the  isoclines  the  cortical  columns.  The  shapes  in  an  object 
imaged  on  the  retina  are  identified  as  the  envelopes  of  the  corresponding 
cortical  fields  that  are  stimulated.  Tracing  through  the  isocline  net 
that  is  stimulated  is  the  analogue  of  the  sKetching  process  described 
in  the  preceding  paragraph. 

Such  a  model  for  the  visual  integrative  process  has  many  points  of 
contact  with  the  psychophysiology  of  the  visual  integrative  process.  It 
is  well  grounded  on  neurophysiological  realities.  It  leads  at  once  to 
explanations  of  such  phenomena  as  the  visual  images  evoked  under  flicker, 
MacKay's  complementary  after  images  (MacKay,  196l)  the  alpha  rhythm  and 
its  desynchronization,  the  specific  language  disability  known  as  develop¬ 
mental  dyslexia  (Bender,  1957),  and  the  visual  Gestalt  (de  Hirsch,  1962). 
The  latter  appears  in  its  simplest  aspects  as  the  invariance  of  the 
differential  equations  of  the  visual  integrative  process  under  the  appro¬ 
priate  Lie  transformation  groups.  Memory  and  the  more  complex  aspects 
of  the  visual  Gestalt,  however,  apparently  require  statistical  decision 
and  prediction  theory  for  the  most  general  sort  of  concepts  in  Lie 
groups  and  differential  topology  (Aus lander  and  Mackenzie,  1963}  Munkres, 
1963}  Steenrod,  1951}  Yano,  1957). 
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IV.  THE  DIFFERENTIAL  EQUATIONS  OF  THE  VISUAL  INTEGRATIVE  PROCESS 

The  is  ocline  interpretation  of  Hubei  and  Wiesel's  micro*,  lectrode 
studies  implies  that  the  visual  integrative  process  is  basfd  upon  s ome 
first  order  differential  equation  (or  equations).  The  question  then 
arises  -  which  first  order  differential  equations?  The  answer  is  pro¬ 
vided  by  the  Gestalt  requirement  Ohat  the  visual  image  be  invariant, 
i.e.,  still  recognizable  as  an  entity,  under  rotations,  translations, 
and  perspective  transformations  (magnifications,  or  dilatations).  We 
therefore  seek  those  differential  equations  whose  family  of  solutions  is 
invariant  under  the  combined  group  of  rigid  motions  (translations  and 
rotations)  and  magnifications.  The  determination  of  these  invariant 
differential  equations  thus  reduces  the  problem  to  an  elementary  com¬ 
putation  in  the  theory  of  Lie  groups. 

That  the  features  of  the  visual  Gestalt  (de  Hirsch,  1962)  must 
involve  invariance  under  a  group  of  transformations  has  been  recognized 
by  several  investigators  (Pitts  and  McCulloch,  1947 J  Culbertson,  1957j 
Rashevsky,  I960).  Pitts  and  McCulloch  viewed  a  pattern  of  stimuli  as 
the  arithmetic  mean  of  a  functional  over  all  the  transformations  of 
the  finite  group  involved.  Culbertson  considered  possible  neuronal 
networks  that  would  generate,  in  the  limit  of  translations,  stimulus 
patterns  invariant  under  translations,  rotations,  and  magnifications. 
Rashevsky's  approach  was  based  on  an  interaction  of  several  central 
complexes  of  neuroelements  in  such  a  way  as  to  produce  the  desired 
invariance  at  a  higher,  coordinating  center.  However,  nom  of  these 
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studies  introduced  the  Lie  group  aspect,  and  it  is  believed  that  this 
io  the  essential  new  feature  that  provides  the  key  to  the  actual  workings 
of  the  visual  Integra tive  process. 

It  will  be  assumed  that  the  Lie  groups  and  differential  equations 
involved  are  2-dimensional.  An  optical  image  on  Jie  retina  is  a  2-dimen¬ 
sional  mapping  of  the  3 -dimensional  world,  and  although  nonplanar,  can 
be  thought  of  as  a  2-dimensional  manifold*.  As  Davson  (1949)  puts  it, 
"The  retina  has  • . .  become  specialized  by  the  development  of  apparently 
veitical  and  horizontal  meridians j  these  act  as  e  pair  of  rectangular 
coordinates  through  the  fovea  to  which  the  position  of  any  point  or  line 
is  referred." 

1  •  Resume,  of  Essentials  of  Lie.  GrquprTheory 

We  shall  here  review  briefly  only  those  aspects  of  Lie  group  theory 
that  will  be  needed  in  the  application  to  Gestalt  psychology  made  below. 
The  reader  will  be  assumed  to  be  acquainted  with  Ch.  IV  of  (Ince,  1956) 
or  its  equivalent.  A  complete  treatment  of  the  classical  projective 
group  may  be  found  in  (Lie  and  Scheffers,  1893)  or  (Kowalewski,  1950) . 

A  reader  interested  in  a  modern  abstract  treatment  of  Lie  groups  is 
referred  to  the  monographs  by  Cohn  (1957)  or  Nomizu  (1956),  or  to 
(Aus lander  and  Mackenzie,  1963). 

The  transformation  in  the  plane 

(*1^)  “  'V**y)  =  (g(x,y),  h(x,y) )  (4) 

»  A  manifold  is  a  connected  compact  topological  space  that  is  locally 
Euclidean. 


- ..  ,  „  . ^ 


l-i.  _ j  .... 

. . 
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constituT  a  group  if  it  has  the  usual  group  properties  (closure, 

existence  of  identity  and  inverse,  associativity).  The  subscript  d 

denotes  a  parameter  (which  is  also  understood  to  be  in  the  arguments 

of  g  and  h)  .  When  T  T  (x,y)  =  T  (x,y)  ,  the  family  (4)  of 

°2  °1  °2+0l 

transformations  is  said  to  form  a  one -parameter  continuous  group, 
denoted  by  G^.  A  Lie  group  is  a  continuous  group  on  a  differentiable 
manifold  suc.i  that  the  differentiability  properties  are  consistent 
with  the  group  properties. 


The  differentiability  structure  enters  via  the  infinitesimal 
transformation  (or  generator)  of  the  group.  Thus  the  system  of  dif¬ 
ferential  equations  equivalent  to  (2): 


Q/v  =  f(x,y), 


(5) 


written  in  the  form 

O-Ch 

can  be  thought  of  as  an  ’’infinitesimal  transformation” 

^Xl,yl^  =  (x  +  +  b ^  =  (x  ^  P(x,y)&<i,y  +  Q(x,y)&d).  (6) 

Each  transformation  of  the  group  can  be  obtained  by  iterating  the  infini¬ 
tesimal  transformation  (x,y)-+  -+  (x  ix,y  +  6y)  a  sufficient  number  of 
times.  In  this  sense  (6)  defines  the  infinitesimal  generator  of  the 


group. 
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If  we  consider  the  variation  induced  on  an  arbitrary  differentiable 
function  by  the  infinitesimal  transformation  (6)  of  the  space  variables, 
we  obtain  the  following  representation  for  the  infinitesimal  generator 
U  of  the  groups 

U  =  P(x,y)^  +  Q(x,y)gp  (7) 

In  particular,  Ux  =  p(x,y)  ,Uy  =  Q(x,y) ,  so  that  an  alternate  form 
for  (7)  is 

o  =  (toOg;  +  (Uy)gp  (8) 

The  finite  equations  of  the  group  are  given  in  terms  of  U  by  the 
Maclaurin  series 

ao 

Ftx^.o)  =  F(x,y)  +  £  (u'Vja'Vn!  =  eUF,  (9) 

where  U11  indicates  an  n-fold  application  of  the  operator  (7).  In 
particular  the  finite  equations  for  the  space  variables  themselves 

are 

CO  oo 

x,  =  x  2  (l^xJcjH/nl,  y,  =  y  +  Z  (Uny)on/nI.  (10) 

1  1  •  1  1 

We  turn  now  to  the  matter  of  invariance  under  a  Lie  group,  and 

first  of  all  define  Invariance  of  a  function  F(x,y)  under  the  action 

of  the  group.  This  means  that  if  (x,y)  -* -♦  (x^,y^)  under  some 

operation(s)  of  the  group,  F(x^,y^)  =  F(x,y)  for  all  d.  A  n.a.s.c. 

for  invariance  of  a  function  F  under  a  group  G,  whose  infinitesimal 
generator  is  U,  is  that  UF  =  0,  which  is,  formally,  a  partial  dif¬ 
ferential  eouation.  Hence  every  one  parameter  group  G^  in  two  variables 
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has  one  and  only  one  Independent  invariant 


C  =  F(x,y) , 


obtained  by  solving  the  system 


dx  _  dy 
P(x,y)  '  Q(x,y) 


It  is  clear  that  if  P  =  0  =  Q  for  some  point  ,  then 

regardless  of  what  F(x,y)  may  be,  UF(xQ,y0)  =  0,  and  (Xq^q)  is 
a  fixed  point  of  the  transformation.  Such  points  are  said  to  be  absolute, 
or  point,  invariants . 

An  integral  curve  of  the  differential  equation  ^  =  ^/?  is  generated 
by  successive  applications  of  U  =  Pg£  +  starting  from  some  initial 

point.  Hence  the  family  of  integral  curves  ( ll)  is  invariant  under  the 
group,  and  is  said  to  display  curve  invariance. 


A  family  of  curves  may  also  be  invariant  in  the  sense  that  the 
individual  curves,  while  shifting  under  U,  still  m.ke  up  the  same  family 
as  before.  A  n.a.s.c.  for  family  invariance  is  that 

UF  =  ((F) ,  (13) 

where  f( F)  is  an  ordinary  function  of  F.  Thus,  for  example,  for 

the  rotation  group 

x^  =  x  cos  a  -  y  sin  a  ,  y^  =  x  sin  d  +  y  cos  d  ,  (14) 


whose  infinitesimal  generator  is 

n  -  ^  ,  8 

rot.  ~  ^c*x  xdy  ’ 


(15) 
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we  have,  letting  F  =  y/x,  that 

UF  =  (y/x)2  +  1  =  F2  +  1. 

That  is,  f  =  1  +  F2,  thus  establishing  the  invariance,  under  rotation, 
of  the  family  y/x  =  const,  of  straight  lines  through  the  origin. 

If  F^(x,y,z)  =  C^,  F^Cx^jz)  =  are  two  independent  solutions 
of  the  partial  differential  equation 

U'F  =  p(*>y)^  +  Q(*»y)^  +  Z(x,y,z)||  =  0, 

then  the  most  general  equation  invariant  under  the  group  whose  infinitesimal 
generator  is  U  is  of  the  form  <2>(F^,F,j)  =  0,  or  in  solved  form,  F 2  =  t(F^). 
This  result  is  basic  to  the  determination  of  the  class  of  differential  equa¬ 
tions  invariant  under  a  given  Lie  group. 

It  can  readily  be  shown  that  the  augmented  transformation 
=  g(x,y;c) ,  y1  =  h(x,yjd),  y{  =  p(x,y,y 1 ;  o) , 

acting  on  the  tricoordinates  (x,y,y’)  in  the  plane,  forms  a  group. 

This  group  constitutes  the  extended  group  of  the  given  group  G^.  Its 
infinitesimal  generator  is 

o'  =  P(x,y)*~+  Q(x,y)“^+  Z(x,y,y')^7  >  (16) 

where  Z(x,y*y')  is  given  by  the  formula 


(17) 
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We  are  now  in  a  position  to  determine  the  form  of  those  first  order 
differertial  equations  invariant  under  a  given  Lie  group. 

Suppose  then  that 

F(x,y,y')  =  0  (18) 

is  a  general  first  order  differential  equation  invariant  under  the 
extended  group  (l6)  .  The  n.a.s.c.  for  this  invariance  the  relation 

U'F  =  0,  (19) 

which  of  course  holds,  either  of  itself  or  by  (18).  This  is  a  partial 
differential  equation  whose  general  solution  requires  two  particular 
integrals  of  the  system 

Pi^r  =  =  zlitTyTyT  •  (20) 

If  F^(x,y)  =  is  a  solution  of  the  first  pair  of  equations,  then 
F-^  is  independent  of  y'  since  P  and  Q  are.  Now  suppose 
¥^{x,y ,y')  =  is  a  solution  of  the  full  system,  and  so  necessarily 
involves  y'.  If  H(Fn)  denotes  an  arbitrary  function  of  F-,  ,  the 
new  function 

F  =  F2  -  H(F1) 

satisfies  the  partial  differential  equation  (19),  i.e.,  U'F  =  0  for 
this  F. 


The  groups  that  we  have  mentioned  as  basic  to  the  visual  Gestalt 


(rotation,  magnification,  translation)  are  each  subgroups  of  ine 
general  projective  group  of  the  plane.  The  finite  equations  of  the 
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projective  group 

alx  +  ^1^  +  C1 
*1  ”  a^x  +  b^y  +  o^* 


*i 


V  1  V  +  C2 

aye  +  by  +  c^’ 


(21) 


define  an  8-perameter  continuous  group  that  takes  straight  lines  into 
straight  lines  and  leaves  at  least  one  point  of  the  plane  fixed  (Lie  and 
Scheffers,  1893).  Through  this  fixed  point  there  passes  an  invariant 
line.  The  infinitesimal  generator  of  the  general  projective  group  is  a 
linear  combination  of  the  eight  operators 


0  ?  a  a  a  a  2  a  ^  a  a  2  a 

Sx’  Py’  X  fix’  y  fix’  x  Py’  y  fy’  X  **  K  y  0y- 


(22) 


The  most  general  projective  transformation  of  the  plane  that  leaves  the 
line  at  infinity  (in  visual  terms,  the  horizon)  invariant  consists  of  a 
linear  combination  of  the  first  six  subgroups  in  (22)  (Lie  and  Scheffers, 
1893). 


Certain  linear  combinations  of  the  subgroups  (22)  will  be  of 
especial  interest  from  the  standpoint  of  the  visual  Gestalt.  These 
may  be  conveniently  summarized  in  the  following  table: 


Group 


Infinitesimal  Generator 


Finite  Equations 


Rotation 


(15) (counterclockwise)  or 

.1 

ftc  -  ~  0y 


7  ST  -  *  5”  (clockwise) 


Magnification  r  - 

(or  similarity  x  ~  +  y  £ 
or  perspective) 


0y 


Translation 
iUgid  motions 


Affine  (or 
linear  group) 


8 


0 


9x  +  y  0y 

/  0  0  \  0  0 
*1  x0y  "  +  *2  8x  +  *3  0y 


( 14)  or  x^  =  x  cos  d  +  y  sin  a, 
y^=-x  sin  d  +  y  cos  resp. 


(23) 


d  d 

x1  =  e  x,  y1  =  e  y 


(24) 


(*1  v  V  +  V5!** 

*  («!  t  ^  ♦  iy)£ 

. ..  *  ..-a  a. 


^  =  x  +  d,  y1  =  y  +  yd  (25) 

x^  =  x  cos  0  -  y  sin  0  +  a,  (26) 
y^  =  x  sin  0  +  y  cos  9  +  b 
x1  =  (a-jX  +  by  +  c^  ,  (27) 

*1  =  («2X  +  V  +  c2) ' 

*lbS  -  a2bl  *  °- 
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2.  Invariant  Differential  Equations  of  the  Visual  Integrative  Process 


Since  the  visual  Gestalt  demands  that  images  be  recognizable  by  their 
intrinsic  over  all  character,  however  they  be  presented  to  the  viewer 
(within  certain  limits),  the  similarity  and  rigid  motion  groups,  (24)  and 
(26),  will  be  basic  to  our  further  considerations.  We  therefore  consider 
the  following  infinitesimal  generator 


u  =  <-*£  + 


9  \  /  3  9  \ 

57>  +  (sJ  +  r 


pCx  ^  +  y 


JL) 

9y'  * 


or 


U 


(p*  -  y  + 


(x  +  py 


+  v>s? 


(28) 


which  combines  the  infinitesimal  generators  of  rotation,  translation, 
and  magnification  groups  in  sufficiently  general  form,  and  seek  the 
most  general  differential  equation  invariant  under  the  combined  group 
of  (28) . 


According  to  (17)  and  (20)  the  invariant  differential  equations 
may  be  determined  from  the  system 

- ^2 - =  - H (29) 

px-y  +  1  x  i  py  +  r  1  +  y' 

The  change  of  variables 

pu  -  v  =  px  -  y  +  1,  u  +■  pv  =  x  +  py  +  y  (30) 

takes  (29)  into  the  equivalent  system 
du  _  dv  _  dy 1 

2 

pu-v  u  +  pv  1-ty' 


(31) 
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According  a a  we  consider 


z  -  u/'x 


or  v  =  v/u  =  l/z, 


as  the  dependent  variable  we  obtain  two  different  forms  of  the  first 
pair  of  eqs.  (31)*  That  is, 

dz  _  _  1  1  +  z2  Qr  dw  _  1  1  +  w2 
dv  ~  v  z  +  p  *  du  ~  u  p  -  w  * 

Separating  variables,  one  obtains  the  respective  equations 

dv_z  +  pj  j  du_p-wJ  ,  - 

-T-  —  2dz’  and  T=f—2dM>  (' 

1  +  Z  1  +  W 


which  may  be  integrated  by  quadratures. 


Thus,  the  first  equation  has  the  solution 


O/v  =  (1  +  iz)^1_iphl  -  iz)^1+ip) 


6  -  (u2  +  v2)^  exp  [arc  tan  . 

Similarly,  from  the  second  equation  of  (33)  > 
CJv  =  (l  +  iw)^1+lp)(l  -  iv)*1^  , 

=  (u2  +  v2)*  exp[  -  arc  tan  =  eff^2<?  . 


With  z  and  w  as  new  variables  the  system  (3l)  may  be  written  as 

dz  _  dw  _  dy* 

2  ”  2  2  * 

1  +  z*  1  +  w  1  -*■  y* 


(36) 
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The  pair  consisting  of  the  first  and  third  of  eqs .  (36)  has  the  solution 


or 


arc  tan  z  +  arc  tan  y’  =  ©(<?), 

tan  9(C)  =  -  Q(Vu2  +  v2  ( 


where  Q  is  an  arbitrary  function  of  the  arguments  shown.  Solving  for 
y'  =  dv/du,  we  obtain  the  following  form  for  the  most,  general  differential 
equation  admitting  the  group  of  (28)  : 


dy  _  dv 
dx  du 


f  2  ±  2  arctan(u/v)N 

u  -  Q(n/u  v  e _  '  )  v 

• 

„/  f  2  ,  2  arc  An(u/v)  \ 

v  -  Q(\/u  +  v  e  '  )u 


(37) 


The  other  pair  of  equations  in  the  system  (36)  yields  the  solution 
arc  tan  w  -  arc  tan  y '  =  0  (<?  )  . 

•'a-  -i-  jl. 


This  equation  can  be  solved  in  a  similar  manner  to  obtain  the  form 
of  the  most  general  1’  ariant  differential  equation  governing  the  con¬ 
jugate  curve: 


r-z - —  -arc tan(  v  /u  ) 

dy  dv  -v  +  £  («/ u  t  v  e  J*  )u 

X  JL  J_  J,  _i_  j. 

dx  du  /---  '  ~r  -a  re  tan  (v  /u  ) 

^  ('iff  2,2  -t-  \ 

-u  -  u  W  u  +  v  e  )v 

J-  J-  JL.  JL.  JL. 


(38) 


If  furthermore  the  form  of  &  is  such  that  at  '  (u,v)  , 


Q 


/  /  2  .  2  -arctan(  v/u) \  _  /  2  ,  2  arctan(u/v)\ 

(vu+ve  '  )  =  -  Q(yu  +  v  e  )> 


(39) 


then  (38)  and  (39)  do  in  fact  determine  curves  that  interest  orthogonally. 


The  paran.'etric  form  of  the  invariant  differential  equations  (37) 
and  (38)  is  as  follows: 


and 


* 


(40) 


(40J 


The  corresponding  second  order  systems  are  then 


( 


- —  +  Q  A.  4.  h  + 

d#2  u  da  11 


*)C)-C  ■!)(!)• 


du  dv  /  \ 

or,  introducing  the  expressions  for  ^  and  from  (40)  , 


da 


(X  'X\ 


(a) 


(42) 


and 


( 


-  [1  -  of) 

daz  t  w 


The  fonn  (41)  is  best  suited  for  analyzing  the  microtime  behavior 
of  the  (u,v)  -field.  Expressions  (41  )  and  (42)  display  the  coupled 
nonlinear  oscillatory  behavior  characteristic  of  the  visual  integrative 

process.  Recalling  that  the  invariant  argument  of  Q  Is  essentially 

r  y  a 

of  the  form  »/u  +  v*  exp{-  arctan(v/u) } ,  we  see  that  (41^)  and  (42) 

can  be  thought  of  as  a  sort  of  vector  Lienard  equation  in  which  each  of 
the  field  variables  acts  as  forcing  function  for  the  other. 
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V.  VISUAL  PHENOMENA  ASSOCIATED  WITH  THE  DIFFERENTIAL  EQUATIONS  OF  THE 
VISUAL  INTEGRATIVE  PROCESS 


1*  Images  Evoked  Under  Flicker  Stimulation 


A  standard  procedure  during  the  taking  of  an  electroencephalograph 
is  the^illumination  of  the  closed  eyes  of  the  subject  by  periodic  flashes 
of  light  at  about  the  frequency  of  the  alpha  rhythm.  Under  such  cir¬ 
cumstances  a  whirling  spiral  image  is  often  evoked,  ani  "whirlpools, 
explosions,  Catherine  wheels"  are  also  seen  (Walter,  1963,  p.  101)  . 

It  is  known  that  a  sudden  flash  of  light  into  the  eyes  will  stimu¬ 
late  the  brain  into  damped  electrical  oscillations  whose  frequency  is 
approximately  that  of  the  alpha  rhythm  (Wooldridge,  1963,  p.  109) .  How¬ 
ever,  the  repetition  of  such  light  pulses  at  a  frequency  near  the 
critical  flicker-fusion  frequency  apparently  results  in  a  constant 
stimulus,  as  it  appears  to  the  visual  cortex.  In  such  circumstances 
the  visual  differential  equations  (37)  and  (38)  provide  a  direct  ex¬ 
planation  of  these  evoked  phenomena  in  the  following  way: 

Let  Q  =  const,  in  (37),  say,  i.e.,  regard  the  stimulus  as  persisting 
over  the  whole  visual  field.  Then  (37)  can  be  written  in  polar  coordinates 
as 

4P=  +  f!.  (43) 

The  solution  of  this  equation  is  the  logarithmic  spiral 

+Q6 
rrte 


r 


(44) 


The  companion  differential  equation  (38)  also  yields  a  logarithmic 

spiral 

-9  /i>2 

r  =  rn  s  "*■  i_.  '  45) 

Cm. 

These  expressions  thus  describe  the  spiral  images  evoked  in  the 
visual  field  by  a  stimulus  that  is  "constant”,  i.e.,  the  same,  in  the 
limit  of  time  resolution,  over  the  whole  family  of  Q-contours.  The 
whirling  character  of  the  spiral  follows  from  letting  a  denote  time 
in  the  parametric  form  (40)  of  the  visual  equations,  and  taking  into 
account  the  resulting  time  variation.  The  other  types  of  evoked  images 
are  more  characteristic  of  the  rest  state  of  the  visual  cortex,  which 
we  now  proceed  to  discuss. 

Complement# *\te ^Images 

MacKay  (1961)  ,  in  his  researches  on  the  perception  of  regular, 
spatially  repetitive  patterns,  found  that  long  raiige  interactions  be¬ 
tween  widely  separated  portions  of  the  visual  field  were  apparently 
essential  to  the  visual  integrate ve  process.  He  noted  four  types  of 
striking  visual  effects  evoked  by  repeated  patterns: 

(i)  "Moir6"  effects,  which  appear  as  flickering  shadows  in  such 
patterns  as  that  of  fig.  8.  They  disappear  upon  retinal  stabilization, 
and  thus  are  apparently  excited  by  the  normal  eye  scanning  movements. 

(ii)  The  "subjective"  colors  observed  in  line  patterns  in  motion 
by  Erb  and  Dallenbach  (1939). 

( i  ii) A  ’streaming  phenomenon"  drifting  at  right  angles  to  the  lines 


in  a  pattern 


(iv)  The  complementary  after  image  (CAI) ,  consisting  of  a  shimmering 
after  effect  seen  for  a  few  seconds  on  a  blank  background  as  a  scurry  of 
wavy  lines  or  shadows  moving  in  directions  essentially  perpendicular  to 
the  lines  in  the  stimulus  pattern  (figs.  8,9,10).  For  details  of  the 
experimental  procedures  the  reader  is  referred  to  the  original  paper 
(MacKay,  1961) . 


Fig.  8 


A  radial  pattern  that  induces  a  circularly  symmetric 
complementary  after  image.  (After  MacKay  (1961)). 


MacKay  established  that  neither  (iii)  nor  (iv)  are  related  to  eye 
movements.  We  note  that  figs.  8  and  9  taken  together  are  essentially 
the  same  as  fig.  11  below,  describing  the  cortical  rest  state.  MacKay’s 
fig.  4  (reproduced  here  as  fig.  10)  shows  the  oscillatory  perturbations 
imposed  on  a  family  of  circles  after  stimulation  by  the  radial  line 
pattern  of  fig.  8. 


m 


iaege.  (After  HacKay  (1961)) 
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We  now  note  that  the  cortical  rest  state  (no  visual  image  present) 
may  be  described  (neglecting  spontaneous  discharges)  by  (37)  and  (38)  with 
Q  =  Q  =0,  i .e. , 

JL  7  J 


dv  u 

du  v 


and 


dv 

JL- 

du 

a. 


(46) 


The  corresponding  second  order  parametric  equations  are,  from  (42), 


,2 

d  u 

,2 

dd 


+  u  =  0, 


d2v 

d„2 


•f  v  =  0 


(47) 


,2 

d  u 


dd' 


-  u  =0, 


a2v 


do' 


-  v  =  0. 


(48) 


The  pair  (47)  represent  true  sinusoidal  oscillations  in  u  and  vj  (48) 
on  the  other  hand  represent  damped  oscillations.  It  thus  appears  that 
sustained  oscillations  are  possible  only  transverse  to  the  u,v-coordinates 
of  the  visual  field.  We  shall  have  more  to  say  in  this  connection  in 
our  discussion  below  of  the  alpha  rhythm. 


The  integrals  of  (46)  are  well  known: 

u2  +  v2  =  a 2  and  v  =  a  u  .  (49) 

X.  J.  J. 

The  first  represents  a  family  of  circles  concentric  about  the  origin}  the 
second  an  orthogonal  family  of  radial  lines  (fig.  ll) .  We  note  that  the 
intersection  of  a  given  radial  line  and  a  given  circle  is  enough  to  define 
a  point  in  the  visual  field  unambiguously. 


It  thus  appears  from  MacKay’s  work  and  the  above  theoretical  result 
that  stimulation  of  the  visual  cortex  by  a  repetitive,  radially  symmetric 
pattern  that  essentially  imposes  a  resonance  on  the  cortical  rest  pattern 
(as  exemplified  by  the  curves  (49)  and  fig.  ll)  can  bring  about  a  "ringing” 


.. “wjgftjaaiL .  - :lu S' frf-W %  ■  frja-W ^ 


of  the  visual  response  in  directions  conjugate  to  the  stimuius  pattern. 
We  note  in  this  connection  that  some  of  MacKay's  subjects  that  suffered 
from  astigmatism  had  difficulty  in  seeing  CAI  (MacKay,  1961,  p.  346). 
Such  a  situation  could  come  about  through  a  failure  to  achieve  resonance 
between  stimulus  pattern  and  an  asymmetric  cortical  rest  state  resulting 
from  continued  astigmatic  distortion.  The  usual  cortical  rest  state, 
as  indicated  by  (49)  and  fig.  11,  is  inherently  symmetric. 

y 


X 


Fig.  11  Integral  curves  for  the  differential  equations  of 
the  cortical  rest  state.  Note  the  resemblance  to 
the  patterns  in  figs*  8  and  9. 

The  visual  phenomena  of  the  cortical  rest  state  outlined  above 
also  apparently  bear  directly  upon  the  circular  images  in  the  eigengrau 
described  by  Jung  (Jung,  1961a,  p.  295). 
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3«  Developmental  Dyslexia  as  a  Variant  of  the  Visual  Differential  Equations 


Developmental  dyslexia  is  a  form  of  specific  language  disability  that 
appears  in  childhood  as  an  almost  crippling  inability  to  read  and/or  write 
(Bender,  1957;  Money,  1961;  Stuart,  1963)  .  It  is  characterized  primarily 
by  an  inordinately  large  number  of  confusions  of  letter  symbols,  especially 
reversals  (’’b"  for  "d" ,  ”p”  for  ”q” ,  ’’saw"  for  "was",  etc.)  ,  which  persists 
well  past  the  first  year  of  school.  The  disability  is  neurologically 
intrinsic:  No  biain  damage  or  significant  impairment  of  vision  or  hearing 
are  present,  and  the  only  emotional  disturbance  is  that  attributable  to 
continued  classroom  difficulties.  Since  these  children  (about  one  out  of 
every  ten)  are  unable  to  learn  by  the  ’’sight  method",  they  are  in  a  very 
real  3ense  victims  of  cur  standard  educational  system.  The  situation  is 
doubly  unfortunate  since  these  children  seem  to  be  extra  well  endowed 
with  creativeness  and  the  capacity  for  abstract  thought  (Bender,  1957)  . 

A  full  treatment  of  developmental  dyslexia  from  the  standpoint  of 
visual  differential  equations  may  be  found  in  Part  II  of  this  study. 

Here  we  cont^at  ourselves  with  outlining  only  those  aspects  of  the  visual 
differential  equations  that  appear  to  be  involved  in  the  reversals  de¬ 
scribed  above. 


If  the  sign  of  the  slope  is  changed  in  (46)  we  obtain  the  new 
sys tem 


dv'  v’ 

*L.  ^  Jl. 

du  ’  ~  u '  ’ 

j.  j. 


dv1 
du 1 


and 


(50) 


Fig.  12.  Integral  curves  for  the  rest-state  differential  equations 
with  reversed  slope*  conjugate  families  of  hyperbolas. 

The  integral  curves  for  this  system  are  the  conjugate  families  of  hyper¬ 
bolas  (fig.  12): 

V2  -  u’2  =  a*2,  and  u'v'  =  a*.  (51) 

X  ^  4. 

Eqs.  (50)  may  be  looked  upon  (see  Part  II)  as  the  rest  state  equations 
for  a  visual  Gestalt  whose  basic  invariances  are  with  respect  to  (clock¬ 
wise)  rotations,  magnification,  and  glide  displacements.  The  essential 
difference  between  systems  (46)  a;;d  (50)  is  that  hyperbolic,  rather  than 
radial,  displacements  are  involved. 

A  similar,  no  doubt  closely  related  hyperbolic  frame  of  reference 
arises  in  a  natural  way  in  Lunebuig's  theory  of  binocular  vision. 

The  hyperbolic  visual  metric  is  probably  the  first  to  develop 
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in  the  infantile  visual  cortex.  Evidence  for  the  existence  of  such  a 
visual  system  during  infancy  can  be  gleaned  from  a  study  of  desell,  Ilg, 
and  Bullis  (1950) .  Sometime  during  the  early  years  of  life  -  commonly 
no  later  than  the  first  year  of  school  -  system  (46)  becomes  dominant. 

The  alpha  rhytun  usually  becomes  well  established  at  this  time  and  the 
dysrhythmia  characteristic  of  the  infantile  (and  dyslexic)  electro¬ 
encephalograph  almost  entirely  disappears. 

Fig  13  is  intended  to  indicate  the  symmetries  in  such  a  hyperbolic 
reference  system  that  could  bring  about  the  letter  and  word  reversals 
described  above.  The  origin  in  system  (46)  is  a  point  of  neutral  sta¬ 
bility,  a  so  called  vortex  (fig.  11).  For  the  reversed  system  (50)  the 
origin  constitutes  a  saddle  point,  a  type  of  singularity  that  is  always 
unstable.  This  suggests  that  the  foveal  pari  of  the  visual  field  is 
inherently  unstable  in  the  dyslexic  case.  As  a  consequence,  for  an  object 
near  the  center  of  vision,  the  visual  integrative  process  could  jump  in 
a  seemingly  random  manner  from  one  quadrant  to  another  and  from  one  branch 
of  the  reference  hyperbola  to  the  other.  The  confusion  that  this  would 
induce  in  a  reading  situation  is  not  hard  to  imagine.  The  peripheral 
vision  on  the  other  hand  should  be  relatively  unaffected. 

The  second  order  equations  that  follow  from  the  parametric  form  of 
(50)  are  all  of  the  damped  oscillation  type: 


=  0. 


Fig.  13  Reproduction  of  fig.  12  with  impressed  letters 

"q",  and  "p".  Each  letter  is  symmetric  with  respect  to 
the  horizontal  or  vertical  axis  separating  it  from  the 
next,  and  symmetric  about  the  origin  to  the  letter  in 
the  opposite  quadrant.  The  origin  is  a  saddle  point, 
a  position  of  unstable  equilibrium. 

This  feature,  too,  is  consistent  with  the  immature  dysrhythmic  type  of 
electroencephalograph  commonly  encountered  in  dyslexic  children  (Bender, 
1957} Cohn,  1949,  p.  597). 

* 

This  of  course  cannot  be  the  whole  story.  The  physiological  origin 
of  the  slope  reversal  is  not  clear,  although  nystagmus  and  labyrinthine 
polarization  may  play  a  role  (Jung,  1961a, b) .  Direction  of  cortical 
scan,  anomalous  depth  reversal  of  electrical  polarization  within  the 
cortex  (Amassian,  1961),  ontogeny*, learning,  and  biochemical  variations 
may  also  enter.  Higher  recognition  phenomena  must  also  involve  the  sort 
of  prediction  and  statistical  decision  processes  that  are  described  in 
Section  VI  of  this  study.  Even  so,  enough  characteristic  features  of 

*  Which  traditionally  recapitulates  phylogeny. 
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developmental  dyslexia  fit  the  reversed  slope  model  -  which  in  itself 
is  based  on  known  visual  neurophysiology  -  to  provide  a  working  hypo¬ 
thesis  . 


4: 


The  AjLphn. 


The  alpha  rhythm  is  a  more  or  less  regular  oscillation,  in  the 
frequency  range  8-13  c.p.s.,  of  the  electric  potential  of  the  brain. 

It  is  most  prominent  in  the  occipital  region  of  the  head,  and  is  appar¬ 
ently  closely  associated  with  the  rest  state  of  the  visual  cortex.  The 
alpha  rhythm  appears  in  the  electroencephalograph  only  when  the  subject 
is  relaxed  and  resting,  with  eyes  closed,  and  mind  free  from  visualiza¬ 
tion  or  deliberation.  Mental  problem  solving  or  opening  the  eyes  (even 
in  a  darkened  room)  result  in  the  "desynchronization"  of  the  alpha  * 
rhythm,  i.e.,  its  replacement  by  a  low-amplitude  oscillation  of  rela¬ 
tively  rapid  fluctuation. 

The  frequency  spectrum  of  the  alpha  rhythm  is  centered  at  about 
10  c.p.s.  (Wiener,  1958,  p.  68).  Other  subsidiary  peaks  in  the  frequency 
spectrum  of  the  electrical  activity  of  the  brain  occur  at  about  5  c.p.s 
(the  so  called  theta  rhythm  at  4  -  7  c.p.s.)  and  near  d.c.  (the  so  called 
delta  rhythm  at  0.  5  -  3*5  c.p.s.).  The  frequency  range  of  the  rapid 
fluctuations  characteristic  of  alert  mental  activity  (the  so  called  beta 
rhythm)  is  14  -  30  c.p.s. (Walter,  1953). 

The  ratios  between  these  frequency  ranges  are  strongly  suggestive 
of  either  subharmonic  oscillations  or  parametric  excitation  (Minorsky, 
1962,  Chs.  19,20).  The  "desynchronization"  of  the  alpha  rhythm  upon 
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presentation  of  a  visual  stimulus  has  such  in  common  with  such  well 
known  differential  equation  phenomena  as  asynchronous  quenching  of  a 
subharmonic  oscillation  (Minorsky,  1962*  Ch.  24)  and  the  detuning  of 
a  parametric  resonance  by  a  sufficiently  large  frequency  excursion 
(Minorsky,  1962,  aeo.  20.5). 

Although  subharmonic  and  parametric  resonance  are  essentially 
different  in  origin,  they  yield  phenomena  which  are  in  appearance 
indistinguishable.  In  true  subharmonic  resonance  the  energy  source 
is  external  and  so  appears  by  itself  on  the  right  hand  side  of  the 
governing  differential  equation  as  a  periodic  forcing  function.  In 
parametric  resonance  on  the  other  hand  the  excitation  arises  through 
a  periodic  variation  of  some  coefficient  (or  coefficients)  of  a  homo¬ 
geneous  differential  equation.  The  essential  subharmonic  nature,  how¬ 
ever,  is  present  in  both  types  of  excitation.  In  both  subharmonic  and 
parametric  oscillations  the  amplitude  of  the  resonance  oscillation 
decreases  with  Increasing  detuning  and  eventually  disappears  at  a 
certain  critical  level. 

An  inspection  of  the  invariant  differential  equations  (37)  and 
(38)  Indicates  that  it  is  more  with  an  unusual  form  of  parametric 
excitation  than  with  asynchronous  quenching  of  a  subharmonic  resonance 
that  we  have  to  do  in  the  present  instance.  The  image  excitation 
appears  as  a  coefficient  of  the  form  variables  (u,v),(u  ,v  )  rather 

■h  <Ai 

than  by  itself  as  a  driving  term. 
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If  we  consider  the  microtime  behavior  of  a  single  neuron,  it 
displays  a  characteristic  repetitive  firing  in  response  to  a  stimulus 
(Jung,  1961a, b).  Although  these  neuronal  discharges  are  certainly  not 
strictly  periodic,  they  do  constitute  "recurrent  ...otions"  in  the  termin¬ 
ology  of  the  qualitative  theory  of  differential  equations  (Nemytskii  and 
Stepanov,  I960)  and  even  appear  to  be  almost  periodic  (ibid) .  The 
characteristic  behavior  of  the  neuron  at  (uq,Vq)  in  the  visual  field 
may  thus  be  represented  as 


2  arctan( 
v  e  v 


u/v) 


=  J  ( u q ,  v Q)  I  6(t  -  Tx)  , 

(u0’V0} 


(52) 


where  J  is  a  coefficient  characteristic  of  the  particular  type 
(A:,3,C,D,  cr  E)  of  neuron  activated  (Jung,  1961a, b)  ,  &( t  -  t)  denotes 
the  delta  function,  and  the  tk’s  comprise  a  relatively  dense  set 
(Nemytskii  and  Stepanov,  I960)  of  time  intervals  characteristic  of  the 
neuronal  type  involved.  J(uq,Vq)  vanishes  if  the  neuron  at  (Uq,Vq) 
is  not  activated  by  the  visual  stimulus. 


It  is  clear  from  the  second  order  visual  field  equations  (41)  with 
(52)  for  the  image  function  Q,  that  it  is  a  radically  different  form 
of  the  differential  equation  of  parametric  excitation  -  if  indeed  it 
can  be  called  that  at  all  -  that  is  involved.  In  fact  the  individual 
equations  resemble  more,  perhaps,  a  sort  of  generalized  Lienard  equation 
with  generalized  functions  as  coefficients.  Although  conditions  for 
the  existence  of  a  periodic  solution  of  the  Lienard  equation  ore-  voll 
known  for  continuous  coefficients  and  periodic  forcing  function  (CeB-.rl, 
1963) ,  nothing  is  apparently  known  about  the  badly  discontinuous  case 
exemplified  by  combining  (41)  and  (52). 
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To  obtain  some  idea  of  the  behavior  of  u  and  v  under  such 
circun stances,  let  us  transpose  all  terms  containing  Q  in  (41)  to 
the  right  hand  side  and  consider  the  equivalent  integral  equation 
Involving  generalized  functions  (Kaplan,  1962) : 


u(t)  =  sin  t  +  K 


v.  aun 

2  0  08  *  '  J(VY0>{*}  *  sin(t  ‘  d£  +  V  + 


+  **(t*  -  (53) 


v(t)  =  K|  sin  t  +  K£  cos  t  - 


J(un,v„)  I  .(  sin(t 

{*)  0 


-  t')[»(t'  - 


dv 

V  (u0  “  dt^ 


-  6'(t'  -  x^v^dt’,  (54) 


where  (*}  denotes  the  set  of  x  £  tj.  Evaluation  of  the  integrals  in 
(53)  and  (54)  by  the  usual  formulas  of  the  theory  of  generalized  functions 
leads  at  once  to  the  forms 


u(t)  = 


sin  t  Jkx  -  J^u^T^sin  +  v^xjcoa  xj  |  + 


+  CO.  t  Jk2  -  \  -  v0(t„).ln  xj  j 

v(t)  =  sin  i  jit,'  +  J»0(\)eo»  -  v^x^ain  x^j  + 


+  cos  t 


|k2  - J  ;  x« +  v0(t*)cos  x*}\  • 


If  these  expressions  are  to  satir;iy  (40)  also,  then  we  must  have 


K«  =  -  K2,  K»  *  K-, 


(57) 
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and  the  following  system  mast  hold  as  well* 


K.  Z  sin  x  +  K-  I  cos  x  =  J  Z  fuJ't  )  Z  cos(t  -  x  )  -  vJt  )  Z  sin(x  -  x  ) } 

lM  “  %)  “  l»]  0  *  M  *  “  *  &»}  *  “  (58) 

K1{I}0°S  ^  +  K2fI}»in  ^  =  -  J{^U0(%)^*ln(T«  ’  V  •  V\)^Y°S(T«  -  V]- 

Solving  the  system  (58)  and  putting  the  result  and  (57)  back  into 
(55)  and  (56),  one  finds,  after  some  straightforward  trigonometric  reduc¬ 
tions,  the  almost  periodic  solutions 


u(t)  - 


4 

■•7t{  Z{ua(t  )  Z  cos(t-x  +x  - x  )  -vJx  )  Z  sin(t+x  -x  -x  )] 

vv  \{«j 0  Mhv!  *  11  v  *  p  v'J 


Z  cos(x^-i:v)  7  f'i0(^Jf)cos(t-tx)+v0(TJ|)sin(t-T>()]^  , 


fr>v} 


v(t:  = 


Z  cos 

t*1  »v  J 


T- f-Zfu.(x)  z  8in(t-T  +T  — x  )+v„(x  )  X  cos(t+x  -X  -X  )] 

’alVTv)  M*j  0  "  fr.v}  '  ^  ’  0  »{„,.}  *  •*  V 


+  ^  Z  c°a(x^-Xy) [u0(T|()sln(  t-x,) -vg(x>)co3( t-x^) ] J  . 


The  almost  periodic  character  of  the  u,v-oscillations  excited  by  a 
neuron  at  (uq,Vq)  firing  at  times  T]_>T2’ *  ’  *  ,TK  ^  ^  ev*<*en*’  ^rora 

inspection  of  (59)  and  (60) .  If  the  neuron  is  of  Jung's  type  A,  which 
discharges  more  or  less  regularly  without  a  specific  stimulus,  at  a 
frequency  in  the  alpha  range  (8  -  15  c.p.s.),  then  the  oscillations 
determined  by  (59)  and  (60)  will  have  the  observed  characteristics  of 
the  alpha  rhythm.  If  a  visual  stimulus  is  presented,  on  the  other  hand, so 


that  the  oequence  is  that  of  the  more  rapid  and  irregular  dis- 

i. 

charges  characteristic  of  neuron  types  B  and  D,  and  C  and  E,  then  a 
"desynchronisation11  of  the  A -type  oscillation  would  appear.  If  ve  now 
suppose  that  the  stimulus  point  (uq,v q)  ranges  over  all  the  cortical 
neurons  that  are  activated  in  the  visual  field  (i.e.,  J  now  represents 
a  summation  over  these  (uq,Vq)),  then  it  is  clear  that  we  have  an  almost 
periodic  oscillation  with  a  distributed  excitation.  Qualitative  versions 
of  this  result  have  been  given  by  Laahley  and  Sholl  ( fiholl ,  1956) . 

We  should  not  lose  sight  of  the  fact  that  the  relatively  dense  set 
is  essentially  a  random  sequence  as  well.  It  is  therefore 
natural  to  associate  an  oscillatory  random  process  'v«ld,  1954 ,  p.  15) 
with  it.  The  more  or  less  regular  oscillation  of  the  alpha  rhythm  may 
then  be  viewed  as  an  instance  of  Slutsky  and  Romanovsky's  "sin. joidal 
limit  theorem"  (Slutsky,  1937) ,  the  burden  of  which  is  that  even  with  a 
purely  random  series,  repeated  pairwise  moving  averages  and  order 
diffeirencing  will  generate  a  cyclic  variation,  which  in  the  limit  is 


sinusoidal. 
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VI.  STATISTICAL  DECISION  AND  PREDICTION  THEORY 

The  Lie  group  operations  that  we  have  considered,  and  the  invariant 
differential  equations  (37)  and  (38)  that  follow  from  them,  have  involved 
only  very  basic  aspects  of  the  visual  integrative  process.  In  actuality, 
however,  visual  pattern  recognition  seems  to  be  a  stagevise  process  in 
which  the  mind  goes  through  a  rapid  series  of  comparisons  with  what  it 
already  knows.  Eventually,  in  proper  Gestalt  fashion,  things  click  into 
place  and  we  recognise  the  pattern  for  what  it  is.  Learning  can  often 
shorten  this  puzzling  over  a  given  pattern  quite  considerably,  which 
again  indicates  the  prominent  role  of  memory  and  prediction  in  the  recog¬ 
nition  process. 

Such  considerations  as  these  lead  us  at  once  into  the  domain  of 
statistical  decision  and  prediction  theory.  Not  a  great  deal  is  known 
in  this  connection  for  the  sort  of  functional  equations  that  are  involved 
in  the  ^sual  integrative  process.  Research  on  the  statistical  aspects 
of  Lie  groups  is  only  little  more  than  a  decade  old  (Brillinger,  1963j 
Grenander,  1963) ,  and  more  work  in  this  field  is  needed  before  a  pre¬ 
diction  and  decision  theory  fully  adequate  for  our  purposes  can  be 
formulated,  Brillinger’s  main  theorem  (Brillinger,  1963,  p»  495)  seems 
to  be  the  closest  available  result  and  would  apparently  suffice  for  the 
basic  aspects  of  the  visual  Gestalt  if  suitable  decision  procedures  and 
risk  functions  could  be  prescribed.  This  aDproach  will  be  discussed  in 
detail  in  a  later  part  of  this  study  devoted  specifically  to  memory  and 
statistical  prediction  and  decision  theory. 


With  regard  to  statistical  invariance  in  general  and  the  prediction 
theory  for  linear  systems  of  random  differential  equations ,  ve  are  in 
a  somewhat  better  position  (Bartlett,  1955)  Beutler,  1963)  Doob,  1953) 
Lehmann,  1959)  Shiryaev,  1963)  Wesler,  1959)  •  The  restricted  minlmax 
and  modified  minimax  (or  "slicing") principles  (Hodges  and  Lehmann,  1952) 
Wesler,  1959)  are  each  directed  toward  making  maximum  use  of  previous 
experience  in  a  statistical  decision  procedure,  and  thus  appear  especially 
appropriate  in  the  present  context.  Wesler'o  approach,  via  partitioning 
the  set  of  states  of  nature  (images)  into  subclasses  or  "slices" , exhibits 
the  stagewise  sort  of  decision  procedure  that  appears  to  be  involved  in 
visual  pattern  recognition. 

The  visual  differential  equations  (40)  and  ( 40^) ,  with  memory,  would 
seem  to  be  a  vector,  predictive  form  of  the  stochastic  differential  equa¬ 
tion  studied  by  I  to  (1951)  and  others.  Systems  whose  parameters  vary 
randomly  in  time,  i.e»,  random  parametric  exoitation,  have  also  received 
study  (see  Bogd&noff  and  Kozin  (1963) »  or  Caughey  and  Dienes  (1962),  and 
the  references  given  there) ,  but  no  prediction  theory  appears  to  have 
been  formulated.  Some  parts  of  the  theory  of  random  parametric  excita¬ 
tion  are  still  controversial,  and  much  remains  to  be  done  here  also.  The 
random  differential  equation  aspect,  as  well  as  that  of  the  modified 
minimax  decision  principle  briefly  mentioned  in  the  preceding  paragraph, 
will  also  be  taken  up  in  a  later  part  of  this  study  devoted  to  statistical 
questions. 

The  introduction  of  statistical  decision  and  prediction  theory 
automatically  raises  the  matter  of  memory.  The  relative  roles  of  bip- 
molecular  (Ifyden,  I960)  Hyd£n  and  figyh&i.  1962,  1963)  and  neuronal 


(Dingman  and  Sporn,  1964)  mechanisms  in  animal  memory  is  immaterial  to 
our  memory  model.  Changes  in  the  truvel  time  of  the  electrical  nerve 
impulse  through  the  neural  net  arising  out  of  either  local  biochemical 
modification  of  the  neuronal  electrical  conductivity  or  dendritic 
lengthening  through  axoplasmic  flow  could  account  for  memory  phenomena 
in  terms  of  oscillations  in  systems  with  time  retardations  (Minorsky, 

1962,  Ch.  21).  Even  though  the  number  of  time  lags  is  finite,  the 
difference-differential  equations  that  are  involved  in  such  retardation 
phenomena  always  have  an  infinite  jpectrum,  i.e.,  such  a  system  can  in 
principle  oscillate  at  an  infinite  number  of  frequencies,  thus  providing 
unlimited  memory  capacity.  In  practice  the  retardations  cause  damping 
of  the  oscillations,  so  that  only  &  finite  number  of  components  contribute 
significantly  to  any  given  oscillation.  In  many  respects  these  retarded 
oscillations  resemble  autoregressive  schemes  (Wold,  1954),  and  the 
phenomenon  of  parametric  excitation,  which  has  been  discussed  briefly 
above  and  in  sec,  V.4,  is  also  involved. 


VII.  CONCLUSION 

The  material  oovered  in  this  report  divides  naturally  into  three 
categories^  (i)  the  cortical  counterpart  of  the  method  of  isoclines, 
the  visual  Gestalt  in'  terms  of  Lie  group  operations ,  and  the  invariant 
differential  equations  of  the  visual  integrative  process;  (ii)  comparison 
with  experimental  evidence*  flicker  phenomena,  complementary  after¬ 
images,  developmental;  dyslexiq  as  slope  reversal  in  the  visual  differ¬ 
ential  equations,  and  the  alpha  rhythm  and  its  "desynchronization"; 

(Hi)  memory  and  recognition  In  terms  of  statistical  decision  and  pre¬ 
diction  theory.  Only  (i)  has  been  given  a  full  treatment  here.  Detailed 
expositions  of  the  role  of  slope  reversal  in  developmental  dyslexia  and 
the  statistical  decision  and  prediction  theory  required  for  a  fuller 
explanation  of  Gestalt,  and  memory  phenomena  will  be  reserved  for  separate 
publications . 


Two  other  important  aspects  of  visual  pattern  recognition  have  not 
been  discussed  in  this  part  (I)  of  the  study,  viz.,  the  cortical  dif¬ 
ferential  processes  involved  in  the  recognition  of  motion  and  curvature 
and  the  neuronal  interconnections  required  by  the  isocline  model  and  the 
visual  differential  equations  (37)  and  (38).  The  former  is  easily 
handled  in  terms  of  the  veil  known  calculus  formulas* 


(62) 
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while,  for  fixed  time,  the  curvature  is  given  by 


or 


(a)  =  [(A)2  +  (4%)2]1/2| 


ds' 


ds 


«(«)  =  (*4 

do  d<r 


f4»/'02  +  #v/2- 

do  do 


(63) 


(64) 


In  these  expressions  l  denotes  either  u  or  v,  3s  the  velocity 

in  the  £  direction,  t  is  time  (a  dot  over  a  variable  indicates  dif¬ 
ferentiation  with  respect  to  time)  ,  o  is  the  cortical  parameter  (phase, 
time,  or  whatever)  ,  a^  is  the  acceleration  in  the  K  direction,  x 
denotes  local  curvature,  and  s  represents  arc  length. 

Whether  the  simple  fields  are  actually  interconnected  within  the 
cortex  in  such  fashion  as  to  process  first  and  second  derivatives  according 
to  the  prescriptions  in  (6l)-(64)  is  an  open  question.  However,  many 
investigators  have  noted  the  necessity  for  something  tnat  is  at  least 
equivalent  to  th  se  operations.  Ao  Granit  (1962,  p.  756)  puts  it, 

M...  the  comical  response  ...  is  adjusted  so  as  to  emphasize  everything 
that  involves  discrimination,  i.e.,  s^nall  fields,  direction,  movement, 
contrast,  almost  as  if  it  were  taking  the  second  derivative  ..." .  We 
further  noted  in  our  discussion  of  Hubei  and  Wiesel's  work  (sec.  II) 
that,  while  both  simple  and  complex  fields  were  sensitive  to  motion 
of  the  light  stimulus,  the  complex  fields  were  esprcially  so.  This 
suggests  that  the  simple  fields  are  interconnected  within  the  complex 
fields  in  such  a  way  as  to  estimate  (6l)  and  (62).  Such  cortical  com¬ 
putation  could  be  accomplished  either  by  further  reciprocally  anta¬ 
gonistic  inhibition  of  the  first  differences  given  by  the  simple  fields 
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Ok*  by  a  further  application  of  the  method  of  isoclines  (Cunningham, 

1958,  seo.  3*3)  to  differential  equations  like  (42)  and  (41^) • 

Concerning  the  neuronal  interconnections  involved  in  the  simple 
fields  that  enable  the  cortex  to  solve  (40)  and  (40^)  approximately, 
there  does  not  appear  to  be  enough  neurophysiological  data  of  the  right 
type  to  permit  pi*eoise  statements.  A  start  in  this  direction  has  been 
made  by  Gerstein  and  Clark  (1964) ,  but  even  then  their  work  is  not  oriented 
toward  the  differential  properties  of  the  neuronal  interactions.  The 
history  of  cytoarchitectural  studies  of  the  cortical  neurons  is  well 
set  forth  by  Sholl  (1956),  but  this  bears  much  more  on  structure  than 
on  funotion*. 

The  inhibitory  character,  both  reciprocally  antagonistic  (time)  and 
lateral  (space),  of  the  neuronal  action  suggests  that  first  and  higher 
differences  are  bound  to  play  an  important  role  in  the  network  of 
neuronal  interconnections.  The  work  of  Fessard  (1961)  is  of  considerable 
interest  in  this  regard.  We  further  note  that  such  difference  operations 
are  not  inconsistent  with  the  autocorrelation  principle  advanced  by 
Relchardt  (1961) ,  since  the  latter  is  implicit  in  such  difference  opera¬ 
tions  as 

average^  -  C^)  =  variance(^)  +  variance^)  -  2  covariance ( 5^, C2) , 

whenever  average^)  =  average U2)  • 

\ 

*  Even  so,  the  resemblance  between  the  structural  character  of  the 
principal  types  of  neuron  present  in  the  cerebral  cortex  (Sholl,  1956) 
and  the  three  types  of  components  (i.e.,  sets  of  trajectories)  that  are 
possible  in  such  systems  as  (40)  or  (40l)  if  they  are  to  be  structurally 
stable  (De  Stggis,  1952)  is  worthy  cf  note. 
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This  concludes  Part  I  of  the  study*  Subsequent  parts  will  deal 
in  detail  with  slope  reversal  in  the  visual  differential  equations  and 
developmental  dyslexia,  statistical  decision  and  prediction  theory  for 
visual  memory  and  Gestalt,  and  the  information  theoretic  aspects  of 
pattern  recognition  by  the  method  of  isoclines. 
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